Mobile terminal and controlling method thereof

ABSTRACT

A mobile terminal including a wireless communication unit configured to wirelessly communicate with at least one other terminal; a microphone configured to receive a first voice input; a touchscreen display; a controller configured to convert the first voice input into first text, display the first text on the touchscreen display, receive a selection signal indicating a selection of the displayed first text, receive a second voice input via the microphone, convert the second voice input into second text, combine the first text and the second text, and display the combined text on the touchscreen display.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of U.S. application Ser. No.14/069,820, filed on Nov. 1, 2013 (now U.S. Pat. No. 9,207,906, issuingDec. 8, 2015), which claims priority under 35 U.S.C. §119(a) toApplication No. 10-2012-0123038, filed in Korea on Nov. 1, 2012, all ofwhich are hereby expressly incorporated by reference into the presentapplication.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a mobile terminal, and moreparticularly, to a mobile terminal and controlling method thereof.

2. Discussion of the Related Art

Generally, terminals can be classified into mobile/portable terminalsand stationary terminals. The mobile terminals can be further classifiedinto handheld terminals and vehicle mount terminals. As functions of theterminal are becoming diversified, the terminal tends to be implementedas a multimedia player provided with composite functions such asphotographing of photos or videos, playback of music or video files,game play, broadcast reception and the like for example.

Recently, a terminal tends to provide various functions through a voicerecognition function. The demands for more convenient voice recognitionfunctions are also increasingly rising.

SUMMARY OF THE INVENTION

Accordingly, one aspect of the present invention is to provide a mobileterminal and controlling method thereof that substantially obviate oneor more problems due to limitations and disadvantages of the relatedart.

An object of the present invention is to provide a mobile terminal andcontrolling method thereof, by which a more convenient voice recognitionfunction can be provided.

Another object of the present invention is to provide a mobile terminaland controlling method thereof, by which information corresponding to apreviously recognized voice is modified to enable various sidefunctions.

Technical tasks obtainable from the present invention are non-limited bythe above-mentioned technical tasks. And, other unmentioned technicaltasks can be clearly understood from the following description by thosehaving ordinary skill in the technical field to which the presentinvention pertains.

Additional advantages, objects, and features of the invention will beset forth in part in the description which follows and in part willbecome apparent to those having ordinary skill in the art uponexamination of the following or may be learned from practice of theinvention. The objectives and other advantages of the invention may berealized and attained by the structure particularly pointed out in thewritten description and claims hereof as well as the appended drawings.

To achieve these objects and other advantages and in accordance with thepurpose of the invention, as embodied and broadly described herein, amobile terminal according to one embodiment of the present invention mayinclude a microphone, a touchscreen, and a controller displaying arecognition result of each of at least one user voice input via themicrophone in a voice recognition mode on the touchscreen, thecontroller, if a user voice is additionally input via the microphonewhile one of the at least one recognition result is selected, processingthe selected recognition result in a manner of combining the selectedrecognition result with a recognition result of the additionally inputuser voice.

In another aspect of the present invention, a method of controlling amobile terminal according to one embodiment of the present invention mayinclude the steps of entering a voice recognition mode, receiving aninput of at least one user voice input via a microphone, displaying arecognition result of each of the input at least one user voice on atouchscreen, receiving an input for selecting one of the at least onerecognition result, and if a user voice is additionally input via themicrophone while the one of the at least one recognition result isselected, processing the selected recognition result in a manner ofcombining the selected recognition result with a recognition result ofthe additionally input user voice.

Effects obtainable from the present invention may be non-limited by theabove mentioned effect. And, other unmentioned effects can be clearlyunderstood from the following description by those having ordinary skillin the technical field to which the present invention pertains.

It is to be understood that both the foregoing general description andthe following detailed description of the present invention areexemplary and explanatory and are intended to provide furtherexplanation of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention and are incorporated in and constitute apart of this application, illustrate embodiment(s) of the invention andtogether with the description serve to explain the principle of theinvention. In the drawings:

FIG. 1 is a block diagram of a mobile terminal according to oneembodiment of the present invention;

FIG. 2 is a front perspective diagram of a mobile terminal according toone embodiment of the present invention;

FIG. 3 is a flowchart illustrating one example of a method of processingvoice recognition results conjointly according to one embodiment of thepresent invention;

FIGS. 4A to 4C are diagrams illustrating one example of a method ofadding a content to a memo, which is written through a voicerecognition, by an additional voice recognition in a mobile terminalaccording to one embodiment of the present invention;

FIG. 5 is a diagram illustrating a different method of selecting amodification desired recognition result and another example of a visualeffect indicating that the modification desired recognition result isselected in a mobile terminal according to one embodiment of the presentinvention;

FIG. 6 is a diagram illustrating one example of a type of displaying apreviously recognized result attributed to performing an additionalvoice recognition in a mobile terminal according to one embodiment ofthe present invention;

FIG. 7 is diagram illustrating one example of a method of adding acontent to a voice-recognition prepared schedule or modifying theschedule by an additional voice recognition in a mobile terminalaccording to one embodiment of the present invention.

FIG. 8 is a diagram illustrating one example of a method of adding asearch word through an additional voice recognition after performing asearch through a voice recognition in a mobile terminal according toanother embodiment of the present invention;

FIG. 9 is a diagram illustrating one example of a method of performing aside function on an information, which was previously input through avoice recognition, using an additionally recognized voice in a mobileterminal according to another embodiment of the present invention;

FIG. 10 is a diagram illustrating another example of a method ofperforming a side function on an information, which was previously inputthrough a voice recognition, using an additionally recognized voice in amobile terminal according to another embodiment of the presentinvention;

FIG. 11 is a diagram illustrating one example of a method of displayinginformation estimated in response to a selection of informationcorresponding to a previously recognized voice, applicable toembodiments of the present invention; and

FIG. 12 is a diagram illustrating one example of a type of performing adifferent operation depending on the number of pointers for selecting apreviously recognized result in a mobile terminal according to a furtherembodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

In the following detailed description, reference is made to theaccompanying drawing figures which form a part hereof, and which show byway of illustration specific embodiments of the invention. It is to beunderstood by those of ordinary skill in this technological field thatother embodiments may be utilized, and structural, electrical, as wellas procedural changes may be made without departing from the scope ofthe present invention. Wherever possible, the same reference numberswill be used throughout the drawings to refer to the same or similarparts.

As used herein, the suffixes ‘module’, ‘unit’ and ‘part’ are used todenote elements in order to facilitate the disclosure only. Therefore,significant meanings or roles are not given to the suffixes themselves,and it is understood that the suffixes ‘module’, ‘unit’ and ‘part’ canbe used together or interchangeably.

Features of embodiments of the present invention are applicable tovarious types of terminals. Examples of such terminals include mobileterminals, such as mobile phones, user equipment, smart phones, mobilecomputers, digital broadcast terminals, personal digital assistants,portable multimedia players (PMP) and navigators. However, by way ofnon-limiting example only, further description will be with regard to amobile terminal 100, and it should be noted that such teachings mayapply equally to other types of terminals such as digital TV, desktopcomputers and so on.

FIG. 1 is a block diagram of a mobile terminal 100 in accordance with anembodiment of the present invention. With reference to FIG. 1, themobile terminal 100 includes a wireless communication unit 110, an A/V(audio/video) input unit 120, a user input unit 130, a sensing unit 140,an output unit 150, a memory 160, an interface unit 170, a controller180, and a power supply unit 190. FIG. 1 shows the mobile terminal 100having various components, but it is understood that implementing all ofthe illustrated components is not a requirement. More or fewercomponents may be implemented according to various embodiments.

The wireless communication unit 110 typically includes one or morecomponents which permit wireless communication between the mobileterminal 100 and a wireless communication system or network within whichthe mobile terminal 100 is located. For instance, the wirelesscommunication unit 110 can include a broadcast receiving module 111, amobile communication module 112, a wireless Internet module 113, ashort-range communication module 114, and a position-location module115.

The broadcast receiving module 111 receives a broadcast signal and/orbroadcast associated information from an external broadcast managingserver via a broadcast channel. The broadcast channel may include asatellite channel and a terrestrial channel. At least two broadcastreceiving modules 111 can be provided in the mobile terminal 100 tofacilitate simultaneous reception of at least two broadcast channels orbroadcast channel switching.

The broadcast managing server is generally a server which generates andtransmits a broadcast signal and/or broadcast associated information ora server which is provided with a previously generated broadcast signaland/or broadcast associated information and then transmits the providedsignal or information to a terminal. The broadcast signal may beimplemented as a TV broadcast signal, a radio broadcast signal, and/or adata broadcast signal, among other signals. If desired, the broadcastsignal may further include a broadcast signal combined with a TV orradio broadcast signal.

The broadcast associated information includes information associatedwith a broadcast channel, a broadcast program, or a broadcast serviceprovider. Furthermore, the broadcast associated information can beprovided via a mobile communication network. In this instance, thebroadcast associated information can be received by the mobilecommunication module 112.

The broadcast associated information can be implemented in variousforms. For instance, broadcast associated information may include anelectronic program guide (EPG) of digital multimedia broadcasting (DMB)and an electronic service guide (ESG) of digital videobroadcast-handheld (DVB-H).

The broadcast receiving module 111 may be configured to receivebroadcast signals transmitted from various types of broadcast systems.By nonlimiting example, such broadcasting systems may include digitalmultimedia broadcasting-terrestrial (DMB-T), digital multimediabroadcasting-satellite (DMB-S), digital video broadcast-handheld(DVB-H), digital video broadcast-convergence of broadcasting and mobileservices (DVB-CBMS), Open Mobile Alliance Broadcast (OMA-BCAST), thedata broadcasting system known as media forward link only (MediaFLO™)and integrated services digital broadcast-terrestrial (ISDB-T).Optionally, the broadcast receiving module 111 can be configured to besuitable for other broadcasting systems as well as the above-noteddigital broadcasting systems.

The broadcast signal and/or broadcast associated information received bythe broadcast receiving module 111 may be stored in a suitable device,such as the memory 160.

The mobile communication module 112 transmits/receives wireless signalsto/from one or more network entities (e.g., a base station, an externalterminal, and/or a server) via a mobile network such as GSM (GlobalSystem for Mobile communications), CDMA (Code Division Multiple Access),or WCDMA (Wideband CDMA). Such wireless signals may carry audio, video,and data according to text/multimedia messages.

The wireless Internet module 113 supports Internet access for the mobileterminal 100. This module may be internally or externally coupled to themobile terminal 100. The wireless Internet technology can include WLAN(Wireless LAN), Wi-Fi, Wibro™ (Wireless broadband), Wimax™ (WorldInteroperability for Microwave Access), HSDPA (High Speed DownlinkPacket Access), GSM, CDMA, WCDMA, or LTE (Long Term Evolution).

Wireless Internet access by Wibro™, HSPDA, GSM, CDMA, WCDMA, or LTE isachieved via a mobile communication network. In this regard, thewireless Internet module 113 may be considered as being a kind of themobile communication module 112 to perform the wireless Internet accessvia the mobile communication network.

The short-range communication module 114 facilitates relativelyshort-range communications. Suitable technologies for implementing thismodule include radio frequency identification (RFID), infrared dataassociation (IrDA), ultra-wideband (UWB), as well as the networkingtechnologies commonly referred to as Bluetooth™ and ZigBee™, to name afew.

The position-location module 115 identifies or otherwise obtains thelocation of the mobile terminal 100. According to one embodiment, thismodule may be implemented with a global positioning system (GPS) module.The GPS module 115 can precisely calculate current 3-dimensionalposition information based on at least longitude, latitude or altitudeand direction (or orientation) by calculating distance information andprecise time information from at least three satellites and thenapplying triangulation to the calculated information. Locationinformation and time information are calculated using three satellites,and errors of the calculated location position and time information arethen amended (or corrected) using another satellite. In addition, theGPS module 115 can calculate speed information by continuouslycalculating a real-time current location.

With continued reference to FIG. 1, the audio/video (A/V) input unit 120is configured to provide audio or video signal input to the mobileterminal 100. As shown, the A/V input unit 120 includes a camera 121 anda microphone 122. The camera 121 receives and processes image frames ofstill pictures or video, which are obtained by an image sensor in avideo call mode or a photographing mode. Furthermore, the processedimage frames can be displayed on the display 151.

The image frames processed by the camera 121 can be stored in the memory160 or can be transmitted to an external recipient via the wirelesscommunication unit 110. Optionally, at least two cameras 121 can beprovided in the mobile terminal 100 according to the environment ofusage.

The microphone 122 receives an external audio signal while the portabledevice is in a particular mode, such as phone call mode, recording modeand voice recognition. This audio signal is processed and converted intoelectronic audio data. The processed audio data is transformed into aformat transmittable to a mobile communication base station via themobile communication module 112 in a call mode. The microphone 122typically includes assorted noise removing algorithms to remove noisegenerated in the course of receiving the external audio signal.

The user input unit 130 generates input data responsive to usermanipulation of an associated input device or devices. Examples of suchdevices include a keypad, a dome switch, a touchpad (e.g., staticpressure/capacitance), a jog wheel, and a jog switch. In FIG. 1, theuser input unit 130 includes a button 136 and a touch sensor 137.

The sensing unit 140 provides sensing signals for controlling operationsof the mobile terminal 100 using status measurements of various aspectsof the mobile terminal 100, the relative positioning of components(e.g., a display and keypad) of the mobile terminal 100, a change ofposition (or location) of the mobile terminal 100 or a component of themobile terminal 100, a presence or absence of user contact with themobile terminal 100, and an orientation or acceleration/deceleration ofthe mobile terminal 100. As an example, a mobile terminal 100 configuredas a slide-type mobile terminal is considered. In this configuration,the sensing unit 140 may sense whether a sliding portion of the mobileterminal is open or closed. According to other examples, the sensingunit 140 senses the presence or absence of power provided by the powersupply unit 190, and the presence or absence of a coupling or otherconnection between the interface unit 170 and an external device.According to one embodiment, the sensing unit 140 can include aproximity sensor 141.

The output unit 150 generates output relevant to the senses of sight,hearing, and touch. Furthermore, the output unit 150 includes thedisplay 151, an audio output module 152, an alarm unit 153, a hapticmodule 154, and a projector module 155.

The display 151 is typically implemented to visually display (output)information associated with the mobile terminal 100. For instance, ifthe mobile terminal is operating in a phone call mode, the display willgenerally provide a user interface (UI) or graphical user interface(GUI) which includes information associated with placing, conducting,and terminating a phone call. As another example, if the mobile terminal100 is in a video call mode or a photographing mode, the display 151 mayadditionally or alternatively display images which are associated withthese modes, the UI or the GUI.

The display module 151 may be implemented using known displaytechnologies. These technologies include, for example, a liquid crystaldisplay (LCD), a thin film transistor-liquid crystal display (TFT-LCD),an organic light-emitting diode display (OLED), a flexible display and athree-dimensional display. The mobile terminal 100 may include one ormore of such displays.

Some of the displays can be implemented in a transparent or opticaltransmittive type, i.e., a transparent display. A representative exampleof the transparent display is the TOLED (transparent OLED). A rearconfiguration of the display 151 can be implemented as the opticaltransmittive type as well. In this configuration, a user may be able tosee an object located at the rear of a terminal body on a portion of thedisplay 151 of the terminal body.

At least two displays 151 can be provided in the mobile terminal 100 inaccordance with one embodiment of the mobile terminal 100. For instance,a plurality of displays can be arranged to be spaced apart from eachother or to form a single body on a single face of the mobile terminal100. Alternatively, a plurality of displays can be arranged on differentfaces of the mobile terminal 100.

If the display 151 and a sensor for detecting a touch action(hereinafter called ‘touch sensor’) are configured as a mutual layerstructure (hereinafter called ‘touchscreen’), the display 151 is usableas an input device as well as an output device. In this instance, thetouch sensor can be configured as a touch film, a touch sheet, or atouchpad.

The touch sensor can be configured to convert pressure applied to aspecific portion of the display 151 or a variation of capacitancegenerated from a specific portion of the display 151 to an electronicinput signal. Moreover, the touch sensor is configurable to detectpressure of a touch as well as a touched position or size.

If a touch input is made to the touch sensor, a signal(s) correspondingto the touch input is transferred to a touch controller. The touchcontroller processes the signal(s) and then transfers the processedsignal(s) to the controller 180. Therefore, the controller 180 is madeaware when a prescribed portion of the display 151 is touched.

Referring to FIG. 1, the proximity sensor 141 can be provided at aninternal area of the mobile terminal 100 enclosed by the touchscreen oraround the touchscreen. The proximity sensor is a sensor that detects apresence or non-presence of an object approaching a prescribed detectingsurface or an object existing (or located) around the proximity sensorusing an electromagnetic field strength or infrared ray withoutmechanical contact. Hence, the proximity sensor 141 is more durable thana contact type sensor and also has utility broader than the contact typesensor.

The proximity sensor 141 can include one of a transmittive photoelectricsensor, a direct reflective photoelectric sensor, a mirror reflectivephotoelectric sensor, a radio frequency oscillation proximity sensor, anelectrostatic capacity proximity sensor, a magnetic proximity sensor,and an infrared proximity sensor. If the touchscreen includes theelectrostatic capacity proximity sensor, it is configured to detect theproximity of a pointer using a variation of an electric field accordingto the proximity of the pointer. In this configuration, the touchscreen(touch sensor) can be considered as the proximity sensor.

For clarity and convenience of explanation, an action for enabling thepointer approaching the touchscreen to be recognized as placed on thetouchscreen may be named ‘proximity touch’ and an action of enabling thepointer to actually come into contact with the touchscreen may be named‘contact touch’. And, a position, at which the proximity touch is madeto the touchscreen using the pointer, may mean a position of the pointervertically corresponding to the touchscreen when the pointer makes theproximity touch.

The proximity sensor 141 detects a proximity touch and a proximity touchpattern (e.g., a proximity touch distance, a proximity touch duration, aproximity touch position, a proximity touch shift state). Informationcorresponding to the detected proximity touch action and the detectedproximity touch pattern can be output to the touchscreen.

The audio output module 152 functions in various modes including acall-receiving mode, a call-placing mode, a recording mode, a voicerecognition mode, and a broadcast reception mode to output audio datawhich is received from the wireless communication unit 110 or is storedin the memory 160. During operation, the audio output module 152 outputsaudio relating to a particular function (e.g., call received, messagereceived). The audio output module 152 may be implemented using one ormore speakers, buzzers, other audio producing devices, and combinationsof these devices.

The alarm unit 153 outputs a signal for announcing the occurrence of aparticular event associated with the mobile terminal 100. Typical eventsinclude a call received, a message received and a touch input received.The alarm unit 153 can output a signal for announcing the eventoccurrence by way of vibration as well as video or audio signal. Thevideo or audio signal can be output via the display 151 or the audiooutput module 152. Hence, the display 151 or the audio output module 152can be regarded as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that can besensed by a user. Vibration is a representative one of the tactileeffects generated by the haptic module 154. The strength and pattern ofthe vibration generated by the haptic module 154 are controllable. Forinstance, different vibrations can be output in a manner of beingsynthesized together or can be output in sequence.

The haptic module 154 can generate various tactile effects as well asthe vibration. For instance, the haptic module 154 may generate aneffect attributed to the arrangement of pins vertically moving against acontact skin surface, an effect attributed to the injection/suctionpower of air though an injection/suction hole, an effect attributed tothe skim over a skin surface, an effect attributed to a contact with anelectrode, an effect attributed to an electrostatic force, and an effectattributed to the representation of a hot/cold sense using anendothermic or exothermic device.

The haptic module 154 can be implemented to enable a user to sense thetactile effect through a muscle sense of a finger or an arm as well asto transfer the tactile effect through direct contact. Optionally, atleast two haptic modules 154 can be provided in the mobile terminal 100in accordance with an embodiment of the mobile terminal 100.

The memory 160 is generally used to store various types of data tosupport the processing, control, and storage requirements of the mobileterminal 100. Examples of such data include program instructions forapplications operating on the mobile terminal 100, contact data,phonebook data, messages, audio, still pictures (or photo), and movingpictures. Furthermore, a recent use history or a cumulative usefrequency of each data (e.g., use frequency for each phonebook, eachmessage or each multimedia file) can be stored in the memory 160.

Moreover, data for various patterns of vibration and/or sound output inresponse to a touch input to the touchscreen can be stored in the memory160.

The memory 160 may be implemented using any type or combination ofsuitable volatile and non-volatile memory or storage devices includinghard disk, random access memory (RAM), static random access memory(SRAM), electrically erasable programmable read-only memory (EEPROM),erasable programmable read-only memory (EPROM), programmable read-onlymemory (PROM), read-only memory (ROM), magnetic memory, flash memory,magnetic or optical disk, multimedia card micro type memory, card-typememory (e.g., SD memory or XD memory), or other similar memory or datastorage device. Furthermore, the mobile terminal 100 can operate inassociation with a web storage for performing a storage function of thememory 160 on the Internet.

The interface unit 170 may be implemented to couple the mobile terminal100 with external devices. The interface unit 170 receives data from theexternal devices or is supplied with power and then transfers the dataor power to the respective elements of the mobile terminal 100 orenables data within the mobile terminal 100 to be transferred to theexternal devices. The interface unit 170 may be configured using awired/wireless headset port, an external charger port, a wired/wirelessdata port, a memory card port, a port for coupling to a device having anidentity module, audio input/output ports, video input/output ports,and/or an earphone port.

The identity module is a chip for storing various kinds of informationfor authenticating a usage authority of the mobile terminal 100 and caninclude a User Identify Module (UIM), a Subscriber Identity Module(SIM), and/or a Universal Subscriber Identity Module (USIM). A devicehaving the identity module (hereinafter called ‘identity device’) can bemanufactured as a smart card. Therefore, the identity device isconnectible to the mobile terminal 100 via the corresponding port.

When the mobile terminal 100 is connected to an external cradle, theinterface unit 170 becomes a passage for supplying the mobile terminal100 with a power from the cradle or a passage for delivering variouscommand signals input from the cradle by a user to the mobile terminal100. Each of the various command signals input from the cradle or thepower can operate as a signal enabling the mobile terminal 100 torecognize that it is correctly loaded in the cradle.

The controller 180 typically controls the overall operations of themobile terminal 100. For example, the controller 180 performs thecontrol and processing associated with voice calls, data communications,and video calls. The controller 180 may include a multimedia module 181that provides multimedia playback. The multimedia module 181 may beconfigured as part of the controller 180, or implemented as a separatecomponent.

Moreover, the controller 180 can perform a pattern (or image)recognizing process for recognizing a writing input and a picturedrawing input carried out on the touchscreen as characters or images,respectively.

The power supply unit 190 provides power required by various componentsof the mobile terminal 100. The power may be internal power, externalpower, or combinations of internal and external power.

Various embodiments described herein may be implemented in acomputer-readable medium using, for example, computer software,hardware, or some combination of computer software and hardware. For ahardware implementation, the embodiments described herein may beimplemented within one or more application specific integrated circuits(ASICs), digital signal processors (DSPs), digital signal processingdevices (DSPDs), programmable logic devices (PLDs), field programmablegate arrays (FPGAs), processors, controllers, micro-controllers,microprocessors, other electronic units designed to perform thefunctions described herein, or a selective combination thereof Suchembodiments may also be implemented by the controller 180.

For a software implementation, the embodiments described herein may beimplemented with separate software modules, such as procedures andfunctions, each of which performs one or more of the functions andoperations described herein. The software codes can be implemented witha software application written in any suitable programming language andmay be stored in memory such as the memory 160, and executed by acontroller or processor, such as the controller 180.

FIG. 2 is a front perspective view of a mobile terminal according to oneembodiment of the present invention. The mobile terminal 100 illustratedin FIG. 2 has a bar type terminal body. However, the mobile terminal 100may be implemented in a variety of different configurations. Examples ofsuch configurations include folder-type, slide-type, rotational-type,swing-type and combinations thereof. For ease of description, thefollowing disclosure will primarily relate to a bar-type mobile terminal100. However, such disclosure may apply equally to other types of mobileterminals.

Referring to FIG. 2, the mobile terminal 100 includes a case (a casing,housing, or cover) constituting an exterior of the mobile terminal. Inthe present embodiment, the case can be divided into a front case 101and a rear case 102. Various electric/electronic parts are loaded in aspace (volume) provided between the front and rear cases 101 and 102.Optionally, at least one middle case can be further provided between thefront and rear cases 101 and 102 in addition.

The cases 101 and 102 are formed by injection molding of synthetic resinor can be formed of metal substance such as stainless steel (STS),titanium (Ti) or the like for example.

A display 151, an audio output module 152, a camera 121, manipulatingunits 131 and 132, a microphone 122, and an interface unit 170 can beprovided at the terminal body, and more particularly, at the front case101. Manipulating units 131 and 132 are part of the user input unit 130(see FIG. 1).

The display 151 occupies most of a main face of the front case 101. Theaudio output module 152 and the camera 121 are provided at an areaadjacent to an end portion of the display 151, while the manipulatingunit 131 and the microphone 122 are provided at an area adjacent to theother end portion of the display 151. The manipulating unit 132 and theinterface unit 170 can be provided at lateral sides of the front andrear cases 101 and 102.

The user input unit 130 is manipulated (operated) to receive a commandfor controlling an operation of the terminal 100. Furthermore, the userinput unit 130 may include a plurality of manipulating units 131 and132. The manipulating units 131 and 132 can be referred to as amanipulating portion and may adopt any tactile mechanism that enables auser to perform a manipulation action by touch.

Content input by manipulating units 131 and 132 can be divided betweenthe two. For instance, a command such as start, end, and scroll is inputto first manipulating unit 131. Furthermore, a command for a volumeadjustment of sound output from the audio output module 152, or acommand for a switching to a touch recognizing mode of the display 151can be input to second manipulating unit 132.

Meanwhile, such a graphic for pointing at a specific object on a displayunit or selecting a menu from the display unit as an arrow, a finger andthe like is called a pointer or a cursor. Yet, the pointer is frequentlyused to mean a finger, a stylus pen or the like for a touch manipulationand the like. In order to clearly discriminate the pointer and thecursor from each other in this disclosure, a graphic displayed on adisplay unit is named a cursor and such a physical means for performinga touch, a proximity touch, a gesture and the like as a finger, a styluspen and the like is named a pointer.

For clarity and convenience of the following description, a mobileterminal mentioned in the following description is assumed as includingat least one of the components shown in FIG. 1.

Conjoint Processing of Voice Recognitions

Recently, mobile terminals include voice recognition functions. However,it is difficult for a general mobile terminal to modify a result fromrecognizing a voice once or perform another function using therecognized voice. Therefore, embodiments of the present inventionprovides a method of modifying a result of a previously recognized voicein a manner of combining the result of the previously recognized voicewith a result of another voice recognition or performing a differentfunction using the modified result and a mobile terminal for the same.

FIG. 3 is a flowchart illustrating one example of a method of processingvoice recognition results conjointly according to one embodiment of thepresent invention. Referring to FIG. 3, the controller 180 of the mobileterminal 100 enters a voice recognition mode for recognizing a voicesignal input via the microphone 122 as a control command (S310).

The controller 180 can enter the voice recognition mode in response to aprescribed command input (e.g., a selection of a shortcut icon of avoice recognition mode, etc.) via the user input unit 130 or thetouchscreen 151 or an occurrence of a specific event for example.However, the present invention may be non-limited by the voicerecognition mode entering method.

The voice recognition mode can be implemented into one application form.While the voice recognition mode is active, at least one partialfunction of at least another application.

Once the voice recognition mode is entered, the controller 180 activatesthe microphone 122, recognizes a voice input via the microphone 122(S320), and then outputs a recognition result in a prescribed form(e.g., a text, an image, a combination of text and image, etc.) to thetouchscreen 151 (S330).

If a user selects the recognition result output to the touchscreen 151(Yes in S340), the controller 180 recognizes an additionally input voice(S350) and then combines the selected recognition result with theadditionally recognized voice (S360).

In this instance, ‘combine’ may mean: 1) change a previously recognizedresult by adding an additionally recognized result to the previouslyrecognized result; 2) output a new recognition result including both ofa previously recognized result and an additionally recognized result; 3)perform a function corresponding to an additionally recognized result inaddition to a previously recognized result; 4) perform an operation fora previously recognized result on an additionally recognized result, andthe like, thereby meaning that a prescribed operation is performed usingat least one portion of information of the previously recognized resultand the additionally recognized result together.

In the following description, a method of modifying a previouslyrecognized result with an additionally recognized result using voicerecognition according to the present invention is explained in detailwith reference to FIGS. 4A to 7. In particular, FIGS. 4A to 4C arediagrams illustrating one example of a method of adding a content to amemo, which is prepared through a voice recognition, by an additionalvoice recognition in a mobile terminal according to one embodiment ofthe present invention.

In the following drawings including FIG. 4A, assume a situation afterentering a voice recognition mode in response to a prescribed commandinput. Also assume that a voice recognized from a user on a userinterface in a voice recognition mode and a controller's response to therecognized voice are output in form of a word balloon (message) threadto the touchscreen 151.

Referring to FIG. 4A, as a voice recognition mode is entered, a userinterface for the voice recognition mode is displayed on the touchscreen151. A user inputs a voice or speech ‘memo’ via the microphone 122 andthe controller 180 then outputs a result of the correspondingrecognition as a text 411 to the touchscreen 151. Moreover, thecontroller 180 determines that the user will use a memo writing functionby recognizing the recognition result as a user command and outputs atext 421 to instruct the user to input a memo content.

The user inputs such a voice as the memo content ‘Let's write aproposal. July’ through the microphone 122. The input voice is convertedto a text 413 by the controller 180 and then displayed on thetouchscreen 151. The controller 180 then displays a text 423, whichqueries whether to save the corresponding recognition result, on thetouchscreen 151. Together with the text 423, a memo application module430 may be displayed on a bottom end of the touchscreen 151. On the memoapplication module 430, a menu for determining whether to save can bedisplayed together with the memo content, i.e., the text 413corresponding to the voice recognized result. In doing so, it can savethe recognized memo content if a save menu displayed on the memoapplication module 430 is selected by a touch input or a voice ‘save’ isinput. Thus, the saved memo can be confirmed or modified by paging amemo application in the future.

In this instance, if the user intends to modify the recognized memocontent by voice recognition, referring to FIG. 4B, the user can selectthe text 413 corresponding to the previously input memo. Hence,prescribed visual effect(s) can be displayed on the text 413corresponding to the previously input memo and/or the memo text 431displayed on the memo application module 430 to indicate that thecorresponding text is selected. In doing so, if a simple touch, aproximity touch or a long touch for prescribed duration is maintainedonto a modification desired recognition result displayed on thetouchscreen 151 or while the corresponding touch state is maintained,the controller 180 can determine that the corresponding recognitionresult is selected. In addition, the prescribed visual effect indicatingthe a presence of the selection may include at least one of a colorchange of a word balloon, an outline emphasized effect, a blinking indifferent color, a presence of an indicator and the like, which will bedescribed in detail with reference to FIG. 5.

Referring to FIG. 4C, while the modification desired recognition result413 is selected, if the user additionally inputs a voice (e.g., Mustfinish until 25^(th) of), the controller 180 can modify the modificationdesired recognition result into a text 413′ using informationcorresponding to the additionally recognized voice. Thus, the text 431displayed on the memo application module 430 can be modified into thetext 413′ as well.

Meanwhile, the selection of the modification desired recognition resultcan be performed in various ways. Further, the controller 180 can informthe user that the modification desired recognition result is selected invarious ways. This operation is described with reference to FIG. 5 asfollows.

In particular, FIG. 5 is a diagram for a different method of selecting amodification desired recognition result and another example of a visualeffect indicating that the modification desired recognition result isselected in a mobile terminal according to one embodiment of the presentinvention.

Referring to FIG. 5( a), a menu ‘Save in continuation’ 433 can beadditionally displayed on the memo application module. If thecorresponding menu 433 is selected, the controller 180 can add arecognition result corresponding to a next-input user voice to apreviously recognized memo.

Referring to FIG. 5( b), in order to help an accurate selection of amodification desired recognition result (to prevent malfunctions) andinform a user that an additional voice recognition is available, thecontroller 180 can control a color of an outline of a voice recognitionicon 510, which is provided to a bottom end of a user interface, togradually change in proportion to a period of time for maintaining atouch input to the modification desired recognition result. If the touchinput is maintained over prescribed duration, referring to FIG. 5( c),the color of the outline of the voice recognition icon 510 can fullychange. If so, the controller 180 additionally recognizes a user voice,which is input after the color has fully changed, and then enables theselected word balloon 413 (i.e., the modification desired recognitionresult) and/or the memo text 431 of the memo application module toreflect the additionally recognized user voice.

Moreover, referring to FIG. 5( d), as the modification desiredrecognition result is selected, the controller 180 may control a cursor435 to be displayed on a region, on which the memo text 431 isdisplayed, of the memo application module or may control a blank box orrow to be additionally displayed on the corresponding region.

In the following description, how to process a previously recognizedresult displayed on a touchscreen in response to an activation of anadditional voice recognition is explained in detail with reference toFIG. 6. In particular, FIG. 6 is a diagram illustrating one example of atype of displaying a previously recognized result attributed toperforming an additional voice recognition in a mobile terminalaccording to one embodiment of the present invention.

In FIG. 6, assume that a user voice ‘Must finish until 25 ^(th,) isadditionally recognized after the text 413 corresponding to thepreviously input memo has been selected in the situation shown in FIG.4B. In FIG. 4C, the result of the additionally recognized voicecombination is exactly displayed as the text 413’ within the selectedword balloon 413. Yet, referring to FIG. 6( a), a word balloon 415according to the additional combination result may be displayed whilethe selected previous word balloon 413 is left intact. And, a responsetext 425 of the controller 180 can be additionally displayed inresponse.

Moreover, referring to FIG. 6( b), a horizontal line 610 may beadditionally displayed to indicate that the selected previous wordballoon 413 has been modified. The recognition result selecting method,the visual effects indicating the selection, and the method ofprocessing the previously recognized result in response to theadditional voice recognition, which are described with reference to FIG.5 and FIG. 6, can be selectively applied to the following embodimentsdescribed with reference to other accompanying drawings.

In the following description, a method of modifying a configuredschedule or adding a content thereto by voice recognition is explainedwith reference to FIG. 7. In particular, FIG. 7 is diagram illustratingone example of a method of adding a content to a voice-recognitionprepared schedule or modifying the schedule by an additional voicerecognition in a mobile terminal according to one embodiment of thepresent invention.

Referring to FIG. 7( a), as a voice recognition mode is entered, a userinterface for the voice recognition mode is displayed on the touchscreen151. A user inputs a voice or speech ‘schedule’ via the microphone 122and the controller 180 then outputs a corresponding recognition resultas a text 711 to the touchscreen 151. Moreover, the controller 180determines that the user will use a schedule add function by recognizingthe recognition result as a user command and outputs a text 721 toinstruct the user to input a schedule hour.

If the user inputs a voice corresponding to the hour, a recognized hour713 is displayed. In addition, the controller 180 outputs a text 723 torequest a schedule content input. Hence, the user inputs a voice ‘Happybirthday party’ via the microphone 122. The input voice is converted toa text 715 by the controller 180 and is then displayed on thetouchscreen 151. The controller 180 combines or integrates therecognition results of the voices input through two changes and thendisplays a text 725, which queries whether to configure a prescribedschedule, on the touchscreen 151.

Together with the text 725, a schedule application module 730 may bedisplayed on a bottom end of the touchscreen 151. On the scheduleapplication module 730, a menu for determining whether to save can bedisplayed together with schedule information corresponding to the resultof the voice recognition of the schedule content. In doing so, it cansave the recognized schedule content if a save menu displayed on theschedule application module 730 is selected by a touch input or a voice‘save’ is input. Thus, the saved schedule can be confirmed or modifiedby paging a schedule application in the future.

In this instance, if the user intends to add information to a specificpart of the recognized schedule content by voice recognition, the usercan apply a touch input to an insertion desired point in the text 715 onwhich the previously recognized schedule content is displayed.

Subsequently, if a voice ‘Min Jung's’ is additionally input, referringto FIG. 7( b), a content corresponding to the additionally input voicecan be added to the selected point, i.e., between ‘Happy’ and ‘birthdayparty’, which is denoted by a reference number 715′. Thus, the scheduleinformation displayed on the schedule application module 730′ can bemodified as well. If a blank part is selected instead of the specificpart of the text within the word balloon shown in FIG. 7( a), a contentcorresponding to an additionally input voice can be added as shown inFIG. 4. Similarly, if the user intends to modify the previouslyrecognized hour, the user selects the text 713 (FIG. 7( c)) and is thenable to modify the hour, as shown in FIG. 7( d), by inputting a vice ofa desired hour to modify.

Conjoint Search

In the foregoing description so far, the present invention is describedcentering on the method of creating such a new information as a memo, aschedule and the like and then modifying the created information. On theother hand, according to another embodiment of the present invention,when a search function by voice recognition is used, a new searchkeyword is combined with a previous search result and then compared.

FIG. 8 is a diagram illustrating one example of a method of adding asearch word through an additional voice recognition after performing asearch through a voice recognition in a mobile terminal according toanother embodiment of the present invention. Referring to FIG. 8, aprescribed situation is assumed as follows. First of all, as a voicerecognition mode is entered, a user interface for the voice recognitionmode is displayed on the touchscreen 151. Subsequently, ‘internetsearch’ is input through voice recognition. In response to the input, atext ‘Input a search word’ is displayed.

Referring to FIG. 8( a), as a search word ‘Nearby Gwanghwamun’ is input,a recognized text 811 is displayed. The controller 180 performs aninternet search using the corresponding text and then displays such asearch result as a response text 821 and a map information 822corresponding to a place around Gwanghwamun. Thus, referring to FIG. 8(b), if a user inputs another search word ‘Nearby Seoul Station’, arecognized text 813, a response text 823 and a map information 824corresponding to a place around Seoul Station can be displayed in order.

In the situation shown in FIG. 8( a), if the user selects the text 811corresponding to the previously recognized search word through a touchinput and then additionally inputs a voice ‘Seoul Station?’ (FIG. 8(c)), a search word corresponding to the additionally input voice isdisplayed together with the previously recognized search word (FIG. 8(d)). In this instance, both of the displayed search words are denoted bya reference number 815.

Hence, the controller 180 performs a search with the search words andthen displays such a search result as a text 825 and a map information826. Thus, the map information corresponding to the displayed searchresult may have a configuration simpler than that of a map informationattributed to a single search word (FIG. 8( d)). Alternatively, the mapinformation corresponding to the displayed search result may bedisplayed in a manner that the map information 822 of the single searchand the map information 824 of the single search are displayed insequence.

For a simple configuration, if one of the search results is selected,the selected search result can be displayed in further detail. Moreover,when a search target is local weather, temperatures, cloudy conditionsand the like can be comparatively displayed together instead of mapinformation. When a search target is a navigation route, distances to adestination, estimated times of arrival at the destination and the likecan be comparatively displayed together.

Conjoint Function Executions

According to a further embodiment of the present invention, proposed isa method of performing a function corresponding to an additionallyrecognized voice using information on a previously recognized voice.

FIG. 9 is a diagram illustrating one example of a method of performing aside function on information, which was previously input through a voicerecognition, using an additionally recognized voice in a mobile terminalaccording to another embodiment of the present invention.

Referring to FIG. 9( a), as a voice recognition mode is entered, a userinterface for the voice recognition mode is displayed on the touchscreen151. A user inputs a voice ‘Text daddy’ via the microphone 122. Thecontroller 180 then outputs a corresponding recognition result as a text911 to the touchscreen 151. Moreover, the controller 180 recognizes therecognition result as a user command and then determines that the userwill send ‘text message’ to a recipient ‘daddy’. Subsequently, thecontroller 180 uses a text 921 to instruct the user to input a messagecontent to send.

If the user inputs a voice corresponding to the message content to send,a recognized content 912 is displayed. The controller 180 outputs a text922 querying whether the user will send the content. Together with thetext 922, a text message application module 930 containing therecognized content can be displayed. In this instance, if the userselects a send menu displayed on the text message application module930, the corresponding content can be sent.

If the text message transmission is completed, referring to FIG. 9( b),a send/cancel menu may disappear from the corresponding module 930′ anda text 923, which indicates that a message has been sent, can bedisplayed. Subsequently, in order to activate a side function, the usercan input a voice ‘other command input’. In response to the input voice,a corresponding recognition text 913 and a response text 924 can berespectively displayed. Thereafter, the user selects the transmissioncompleted text message application module 930 and is then able to inputa voice ‘forward to mom and brother’.

Hence, referring to FIG. 9( c), the controller 180 can display a text925 which asks the user whether to forward a message containing the samecontent of the previously sent message to mother and brother. Moreover,the controller 180 can display a text message application module 940, towhich the same content of the previously sent message is input, withrecipients set to mom and brother. In this instance, if the user selectsa send menu displayed on the text message application module 940 orinputs a voice ‘send’, the text message transmission can be performed ina manner represented in the text message application module 940.

As a result, referring to FIG. 9( d), the controller 180 determines thata recipient of the text message containing the same content is added andthen displays a text message application module 940′ having recipientsmodified and a text 926 indicating that the transmission is completed.When the recipient is modified as shown in FIG. 9( d), the previous textmessage application module 930′ may disappear from the user interface ora horizontal line may be displayed thereon as shown in FIG. 6( b).Unlike FIG. 9( d), if the recipient is not modified, the previous textmessage application module 930′ can be maintained as it is.

In addition, when ‘send’ is not selected in the situation shown in FIG.9( a), while ‘input other command’ for activating a side function is notinput, if the recognized message content 912 is selected, it can add aninformation corresponding to an additionally recognized voice to thecorresponding content, as shown in FIG. 4. Moreover, a position forinserting the information corresponding to the additionally recognizedvoice may be changed in response to a touched part in the recognizedmessage content 912.

In the following description, a case of a voice call in accordance withvoice recognition is explained in detail with reference to FIG. 10. Inparticular, FIG. 10 is a diagram illustrating another example of amethod of performing a side function on an information, which waspreviously input through a voice recognition, using an additionallyrecognized voice in a mobile terminal according to another embodiment ofthe present invention.

Referring to FIG. 10( a), as a voice recognition mode is entered, a userinterface for the voice recognition mode is displayed on the touchscreen151. A user inputs a voice ‘Phone call’ via the microphone 122. Thecontroller 180 then outputs a corresponding recognition result as a text1011 to the touchscreen 151. Moreover, the controller 180 recognizes therecognition result as a user command and then determines that the userwill make a voice call.

Subsequently, the controller 180 uses a text 1021 to instruct the userto input a callee. If the user inputs a voice corresponding to a name ofthe callee, a recognized content 1013 is displayed. The controller 180searches a phonebook to obtain contact information corresponding to theinput voice and then outputs a text 1023 querying whether the user willconnect a voice call to a corresponding contact.

Thus, if the user intends to modify/change the currently recognized name‘HONG Gil Dong’, the user selects the recognized callee 1013 and thenadditionally inputs a voice. On the other hand, when the user intends tochange a current function into a multi-user conference call by addingcallee(s), the user can input a voice ‘other command input’. In responseto the input voice, a corresponding recognition text 1015 and a responsetext 1025 can be respectively displayed on the touchscreen 151.

Subsequently, if the user additionally inputs a voice ‘Call with HONGGil Sun’, referring to FIG. 10( b), the recognized voice can bedisplayed as a text 1017 together with the previously recognizedcounterpart. In doing so, the controller 180 recognizes that a pluralityof call counterparts are selected owing to the added call counterpart,determines that the user requests the multi-user conference callfunction, and is then able to output a text 1027 querying whether toactivate the multi-user conference call function.

Estimated Information Display

When information on a previously recognized voice is selected, a mobileterminal according to the present invention estimates a command a userwill input additionally and is then able to display the estimatedcommand. This operation is described in detail with reference to FIG. 11as follows.

FIG. 11 is a diagram illustrating one example of a method of displayinginformation estimated in response to a selection of informationcorresponding to a previously recognized voice, applicable toembodiments of the present invention. Referring to FIG. 11( a), as avoice recognition mode is entered, a user interface for the voicerecognition mode is displayed on the touchscreen 151.

A user inputs a voice ‘Make a phone call to HONG Gil Dong’ via themicrophone 122. The controller 180 then outputs a correspondingrecognition result as a text 1111 to the touchscreen 151. Moreover, thecontroller 180 recognizes the recognition result as a user command andthen determines that the user will make a voice call. Subsequently, thecontroller 180 searches a phonebook to obtain contact informationcorresponding to HONG Gil Dong and then outputs a text 1121 queryingwhether the user will connect a voice call to a corresponding contact.

Irrespective of whether the call is connected, if the user inputs avoice ‘other command input’, a corresponding recognition text 1113 and aresponse text 1123 can be respectively displayed on the touchscreen 151.In doing so, if a ‘HONG Gil Dong (i.e., callee)’ part is selected fromthe initially recognized text 1111, referring to FIG. 11( b), thecontroller determines functions that can be executed for the callee‘HONG Gil Dong’ and is then able to display a corresponding result 1130on the touchscreen 151. Thus, a frequency of use, a recently activatedorder and the like can be taken into consideration in determining a sortorder of the determined result 1130.

Meanwhile, if a part ‘phone call’, which is an executable function, isselected from the initially recognized text 1111 (FIG. 11( c)), thecontroller 180 determines other callees to them ‘phone call’ can be madeand is then able to display a corresponding result 1140 on thetouchscreen 151 (FIG. 11( d)).

Additional Voice Input depending on the Number of Pointers

According to a further embodiment of the present invention, proposed isa method of performing a different operation depending on the number ofpointers (i.e., touched points) for simultaneous touches in selectinginformation on a previously recognized voice.

FIG. 12 is a diagram illustrating one example of a type of performing adifferent operation depending on the number of pointers for selecting apreviously recognized result in a mobile terminal according to a furtherembodiment of the present invention. Referring to FIG. 12( a), as avoice recognition mode is entered, a user interface for the voicerecognition mode is displayed on the touchscreen 151.

A user inputs a voice ‘Text daddy’ via the microphone 122. Thecontroller 180 then outputs a corresponding recognition result as a text1211 to the touchscreen 151. Moreover, the controller 180 recognizes therecognition result as a user command and then determines that the userwill send ‘text message’ to a recipient ‘daddy’. Subsequently, thecontroller 180 uses a text 1221 to instruct the user to input a messagecontent to send. If the user inputs a voice corresponding to the messagecontent to send, a recognized content 1213 is displayed.

The controller 180 outputs a text 1223 querying whether the user willsend the content. Together with the text 1223, a text messageapplication module 1230 containing the recognized content can bedisplayed. In this instance, if the user selects the text 1213representing the recognized content of the text message with a singlefinger (i.e., to create a single touch point), an additionally inputvoice can be added to the corresponding text.

On the other hand, if the text 1213 representing the recognized contentof the text message is selected with two fingers (i.e., to create twotouch points), as shown in FIG. 12( a), an additionally input voice canbe recognized as a command for performing a side function.

For instance, referring to FIG. 12( b), when the additionally inputvoice is ‘Attach gallery photo’ 1215, the controller 180 determines thatthe user intends to attach an image to the corresponding message,outputs a text 1225 indicating that a gallery application is about to beactivated, and can then activate the gallery application. If an image tobe attached to the gallery application is selected, referring to FIG.12( c), the selected image is attached and then displayed on the textmessage application module 1230′.

In another instance, referring to FIG. 12( d), when the additionallyinput voice is ‘Add recipients’ 1217, the controller 180 determines thatthe user intends to add recipients of the corresponding message and thenoutputs a text 1227 instructing the user to input additional recipients.Hence, if the user inputs the additional recipients 1219 with a voice,the controller 180 outputs a response text 1229 and the added recipientscan be displayed on the text message application module 1230.”

Meanwhile, unlike FIG. 12, a specific function can be directly activateddepending on the number of simultaneously touched points without anadditional voice recognition. For instance, if a text corresponding to arecognized text message content is selected with two fingers, a galleryapplication for image attachment can be active.

If the text corresponding to the recognized text message content isselected with three fingers, the text 1227 instructing the user to inputadditional recipients can be instantly displayed. In this instance, itis preferable that the number of points simultaneously to a singlerecognition result and a function matching the number are determined inadvance. Further, the corresponding matching relation can be changed bya user.

In the above-described embodiments of the present invention, when a textfor a response to a recognition result of a user voice or a text for auser voice input request is output in a voice recognition mode, thecontroller can control a voice corresponding to the text to be outputvia the audio output unit 152. Alternatively, an audio can be outputonly without outputting (or displaying) the corresponding text.

Accordingly, the present invention provides the following advantages.First of all, more various and convenient functions can be providedthrough voice recognition.

Secondly, the present invention selects information corresponding to apreviously recognized voice and modifies the corresponding informationby activating a voice recognition function again or can perform variousside functions using the modified information.

It will be apparent to those skilled in the art that variousmodifications and variations can be specified into other form(s) withoutdeparting from the spirit or scope of the inventions.

According to one embodiment of the present invention, theabove-described methods can be implemented in a program recorded mediumas processor-readable codes. The processor-readable media include allkinds of recording devices in which data readable by a processor aresaved. The processor-readable media include ROM, RAM, CD-ROM, magnetictapes, floppy discs, optical data storage devices, and the like forexample and also include transmission via Internet, etc.

The aforementioned embodiments are achieved by combination of structuralelements and features of the present invention in a predetermined type.Each of the structural elements or features should be consideredselectively unless specified separately. Each of the structural elementsor features may be carried out without being combined with otherstructural elements or features. Also, some structural elements and/orfeatures may be combined with one another to constitute the embodimentsof the present invention.

It will be apparent to those skilled in the art that variousmodifications and variations can be made in the present inventionwithout departing from the spirit or scope of the inventions. Thus, itis intended that the present invention covers the modifications andvariations of this invention provided they come within the scope of theappended claims and their equivalents.

What is claimed is:
 1. A mobile terminal comprising: a wirelesscommunication unit configured to wirelessly communicate with at leastone other terminal; a microphone configured to receive a first voiceinput; a touchscreen display; and a controller configured to: convertthe first voice input into first text, display the first text on thetouchscreen display, receive a selection signal indicating a selectionof the displayed first text, receive a second voice input via themicrophone, convert the second voice input into second text, combine thefirst text and the second text, and display the combined text on thetouchscreen display.